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6.  Results 
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Chief.  ;0.-.:,al  i,irur=.:.tloa  Division 

The  inputs  and  outputs  of  an  (n,k)  convolutional  code  (CC)  can  be  represented. 


respectively,  as  D-transforms 


x(D)  -  £  x,  *D^ 

j-0  J 


y(°)  ■  l  y**^  (2) 

j-0  J 

of  the  input  sequence  of  k-vectors  of  form  x^  -  [x^  ,x2j , . . . ,xfcj ]  and  the  output 
sequence  of  n-vectors  of  form  -  [y^  ,y2j  , . . .  ,y^  ] ,  where  x  and  y  belong  to 
a  finite  Galois  field  F  =  GF(q)  usually  restricted  to  the  binary  field  GF(2)  of 
two  elements,  and  D  is  the  delay  operator.  The  input  x(D)  and  the  output  y(D)  are 
linearly  related  by  means  of  a  kxn  generator  matrix  G(D)  as  follows: 

y(D)  -  x(D) *G(D) ,  (3) 

where  the  elements  of  G(D)  are  assumed  usually  to  be  polynomials  over  the  finite 
field  GF(q)  ,  where  q  is  the  power  of  a  prime  number.  The  maximum  degree  M  of  the 
polynomial  elements  of  G(D)  is  called  the  memory  delay  of  the  code,  and  the 
constraint  length  of  the  code  is  K  -  M+l. 

In  order  to  avoid  catastrophic  error  propagation,  the  encoder  matrix  G(D) 
is  assumed  to  be  basic.  For  the  basic  encoder,  the  Smith  normal  form  of  G(D)  is 

G  =  A-[Ik,D].B  (4) 

where  A  =  A(D)  is  a  k*k  invertible  matrix  with  elements  in  F[D],  the  ring  of 
polynomials  in  D  over  F,  and  B  -  B(D)  is  an  nxn  invertible  matrix  with  elements  in 
F[D] .  The  elements  of  the  inverses  A  1  and  B-1  of  matrices  A  and  B,  respectively. 


are  polynomials  in  F[D]. 


By  definition, 

G(D)*HT(D)  -  0 

where  H(D)  is  the  parity  check  matrix.  Let 


(5) 


B 


B, 


B„ 


(6) 


and 


B_1  =  [B^), 


(7) 


where  the  first  k  rows  of  B  constitute  submatrix  B1  and  the  remaining  (n-k)  rows 


.-1 


are  matrix  B^,  and  where,  likewise,  the  first  k  columns  of  B  constitute  submatrix 


B^  and  the  remaining  (n-k)  columns  are  matrix  B^.  Since 


B*B 


-1 


B, 


B„ 


•  [BrB2] 


B1B1»  B1B2 


B2B1*  B2B2 


=  I 


we  get 


B.B  =  I,  , 

B,B„ 

11  k 

1  2 

Vl  '  »• 

B2B2 

partition,  Eq.  (7), 

the  parity 

—  T 

H  =  B2 

(8) 


(9) 


It  should  be  noted  that  the  parity-check  matrix  is  not  unique.  For  example, 

T 

it  can  be  shown  that  H  =  CI^  is  a  parity-check  matrix  where  C  is  any  (n-k)  x(n-k) 
invertible  matrix  with  elements  in  F[D]. 

Let  the  received  codes  be 

z(D)  -  y(D)+e(D),  (10) 


where  e(D)  is  the  D-transform  of  the  error  sequence.  The  syndrome  of  the 
received  code  z(D)  Is 


s(D)  -  z(D) *HT(D) 
-  (y+e)-HT 
=  (xG+-e) 


Since  G*H 


D,  we  get 


s  =  e* 


(ID 


(12) 


It  has  been  shown  [1]  that  the  set  of  solutions  is  a  coset  of  the  set  of  all 
codewords. 

To  explicitly  solve  the  syndrome  equation,  Eq.  (12),  substitute  H  as  given 
by  Eq.  (9)  in  Eq.  (12),  thereby  obtaining 

s  =  eB2  =  eB 

In  Eq.  (13),  let 

c  -  eB-1,  (14) 


n-k 


(13) 


So  that  F.q .  (13)  becomes  the  simple  equation 


5 

(15) 

where  s  =  ^Sl,s2’*  ‘  ’  ,Sn-k^  an<*  e  =  ^ei»e2* '  *  *  »Gn^  *  8eneral  solutions  of 

Eq.  (15)  over  the  ring  F[D]  is  given  evidently  by 


[el,e2*  *  * '  *e10^  “  ^t1»t2 . Tk^  “  T» 

lek+l,ek+2’**,,en1  “  tsl,S2»'*',Sn-k]  "  8 


(16) 


where  t_.  =  (D)  are  arbitrary  elements  in  F[d].  Thus,  more  compactly,  the 

general  solution  of  Eq.  (14)  is 


e  ■  [t,S]  «=  eB 


(17) 


where  t,  as  in  Eq.  (16),  is  an  arbitary  k-vector  of  elements  in  ring  F[D). 
Finally,  a  multiplication  of  both  sides  of  Eq.  (17)  by  B  yields 

-  tB1+sB2  (18) 

T 

From  the  identity  in  Eq.  (8)  and  (9)  that  B2  is  the  left  inverse,  denoted 
by  H  \  of  parity-check  matrix.  Hence, 

B2  -  (H-1)T,  (19) 

where  H  1  is  the  left  inverse  of  H.  From  the  Smith  normal  form  in  Eq.  (4)  of 
a  basic  encoder  that 

A-1G  =  [Ik,0)-B  =  B1  (20) 

A  substittuion  of  B^  in  Eq.  (20)  and  B2  in  Eq.  (19)  into  Eq.  (18)  obtains 


e  =  eB  =  t  t , s] * 


B, 


e  =  tA  *G+s(H  *)^. 


(21) 


Since  t  is  an  arbitrary  k-vector  of  elements  in  F[D] , 


t  =  tA 


is  also  an  arbitrary  vector  of  polynomials  in  F[D] .  Substituting  t  in  Eq.  (22) 
into  Eq.  (21)  yields, 

e  =  tG+s (H-1)X  (23) 

as  the  general  solution  of  syndrome  equation,  Eq.  (12). 

Towards  this  end,  substitute  Eq.  (19)  into  Eq.  (23)  and,  by  Eq.  (9)  and 
(11),  the  quantity  z-B2  ^or  syndrome  s.  These  substitutions  yield 

e  =  (t)Gfz*(B2*B2)  (24) 

Let  R  =  B2  B2 ,  since  B2  and  B2  have  rank  (n-k)  ,  it  can  be  shown  that  matrix 
R  =  B2  B2  also  has  rank  (n-k).  A  substitution  of  R  into  Eq.  (24)  yields 

e  *>  tG+zR  (25) 

By  the  maximum  likelihood  principle,  the  most  likely  error  sequence  is  the  one 
with  minimum  Hamming  weight.  Given  z(D),  the  sequence  e(D)  with  minimum  Hamming 
weight  is  found  by  minimizing  the  weight  of  the  right  side  of  Eq.  (25)  over  all 
polynomials  t(D)  in  F[D].  That  is, 

min||e||  =  min  ||tG+zR||,  (27) 

teFlD) 

what  one  attempts  to  do  in  Eq.  (27)  is  to  find  that  sequence  t  which,  when 
encoded  as  tG  and  subtracted  from  z*R,  yields  the  sequence  e  of  minimum  Hamming 
weight.  That  is, 

e  »  tC+zR  (28) 


.VAW.VA'.V.'’ 


Wav  r  , 


7 


is  the  D-transform  of  the  minimum  weight  possible  error  sequence. 

By  Eq.  (4),  the  right  inverse  G  ^  of  the  generating  matrix  G  is 


P:I- 


From  Eq.  (28)  and  Eq.  (29) ,  one  obtains 


e^G-1  =  ItG+zB2  B2]*g“1 


=  t+z  *B2  *B2 


=  t+zB2 ♦ [ 0 


-  -  -i 

»B_]  ♦  *A  1 

L 0  _ 

T  1  lk  A-1 

’Vk1*  ’A 

n  k  0 


By  Eq.  (10),  the  subtraction  of  e  from  z  produces  a  best  estimate  y  of  the 
transmitted  code,  i.e.. 


y  =  z-e. 


If  multiplied  on  the  right  by  G,  yields 


A  A  “  I 

x  =  y *G  \ 


the  best  estimate  of  the  original  message.  Hence,  substituting  Eq.  (31)  in 
Eq.  (32)  and  using  Eq.  (30)  produces 


x  =  (z-e) *G 


-1  - 
z-G  -t 


This  important  identity  shows  that  t  =  t(D),  obtained  by  the  minimization  in 
Eq.  (27),  is  a  correction  factor  to  the  standard  method  of  recovering  the 
message  from  z  =  z(D)  if  z  were  noise-free. 

The  above  results  are  now  applied  to  systematic  convolutional  codes.  The 
generator  matrix  for  a  systematic  CC  has  form 

G(D)  -  [Ik,  P(D) ]  (34) 

where  1^  is  the  kxk  identity  matrix  and  P(D)  is  a  kx(n-k)  of  polynomials  over 
GF(q)  in  the  delayed  operator  D.  A  parity  check  matrix  associated  with  G(D)  in 
Eq.  (34)  is  the  (n-k)*n  matrix, 

H(D)  =  l-PT(D) ,  Ink)  (35) 

The  Smith  normal  form  of  Eq.  (34)  is,  by  Eq.  (14), 


G  =  A[Ik,  0]B 


Hence,  for  a  systematic  code. 


A  =  I,  and 
k 


(36) 


(37) 


the  inverse  of  B  is  found  to  be 


9 


The  partitions,  given  in  Eqs.  (6)  and  (7)  ,  of  B  and  B  ,  respectively,  are,  for 
a  systematic  CC, 


where 


B1  =  Uk’  P(D)]  and  B2  =  [0»  Vk1 


where 


n"1  -  [B^  B2], 


*1’  0  “d  I 


Consequently,  the  syndrome  s  in  Eq.  (12)  is 


s  =  z-H  =  Z- 


=  tz_,2  ]* 

m  p 


=  -z  (D) *P(D)+z  (D),  (41) 

in  p 

where  z^(D)  is  the  message  code  vector  of  k  components,  possibly  corrupted  by 
noise,  and  z^(D)  is  an  (n-k)  component  vector  of  parity  symbols,  also  possibly 
changed  by  channel  noise. 

Next,  by  Eqs.  (39)  and  (40),  the  matrix  R  in  Eq.  (26)  is  given  by 


.*sev 


R  ■  B2  b2 


[0-  W 


e  =»  tG+zR  =  t[Ik,P]+z 


0,  -P 

0,  I  • 


0,  -p 
0»  I 


=  [tl.,  tP(D) ]  +  0,  z 


=  [ t(D) ,  (t(D)-zm(D))P(D)+zpCD)],  (43) 

where  z^tD)  is  the  received  message  sequence  "in  the  clear",  zp(D)  is  the 
received  parity  sequence  of  CC,  and  t(D)  is  an  element  of  F[D] .  By  Eq.  (41), 
the  above  general  solution,  Eq.  (43),  of  the  syndrome  equation  for  a  systematic 
CC  can  be  expressed  in  an  alternate  form 


e(D)  =  [ t (D) ,  t (D)P(D)+s(D) ] , 


Let  e  denote  the  error  sequence  of  the  solution,  Eq.  (44),  of  minimum 
Hamming  weight,  and  let  t  be  element  t(D)  e  F[D] ,  for  which  the  Hamming  weight 
of  e(D)  in  Eq.  (43)  or  Eq.  (44)  is  a  minimum.  Then,  by  Eqs.  (43)  and  (44), 
as  in  Eq.  (28),  e  and  t  are  related  by 


e  =  [t,  (t-z  ) -P+z  ] 
m  p 


[t,  tP+s]. 


By  Eqs.  (29),  (36),  and  (38),  the  right  inverse  of  the  generator  matrix  C  in 
Eq.  (34)  is 


Again,  the  subtraction  of  e  from  z  produces 


y 


z-e 


as  the  best  estimate  at  transmitted  code,  so  that 


A  l  f  A.  “1  — 1  A 

X  =  yG  =  (z-e) -G  =  zG  -t 


[z  ,0 

m  p 


k 

0 


•t  =  z  -t 
m 


(47) 


as  the  best  estimate  of  the  received  message  in  terms  of  zm,  the  received  message 
in  the  clear,  and  the  correction  factor,  t. 

Next,  we  are  going  to  give  an  example  on  the  error  trellis  syndrome  decoding 
of  Wyner-Ash  convolutional  code. 

If 


G(D)  =  C_+C1D+. ..+G  Dm 
0  1  m 


(48) 


is  a  generator  matrix  of  a  CC  of  memory  M  =  m,  as  defined  in  Eq.  (3),  then 
evidently 


12 


is  the  infinite  generator  matrix  associated  with  G(B)  .  Thus,  a  systematic  code 
with  generator  matrix  G(D)  =  [I  ,  P(D)]  has 


\  p0  0  P1  °  P2 


...  0  P 


!k  PQ  0  Px  0  ... 
*k  po  0  ••• 


o  p 


0  P 


as  its  companion  infinite  generator  matrix,  where 


r\ 

P(D)  =  P.+P1IH-P0DZ+...+p  Dm 
U  -L  z  m 


where  0  is  the  k*k  all  zero  matrix  and  Pj^  is  the  k*(n-k)  matrix.  By  Eq.  (35), 
the  associated  parity-check  matrix  is 


T 

V  1 

T  T 

P1  0  P0  1 

P2T  0  PXT  0  I 

T 

P  0 
m 

T 

P  0 
m 


In  terms  of  Eq.  (51)  and  (52),  Blahut  defines  an  (n  ,k)  =  (2m,2m-l)  Wyner-Ash 

code  as  follows:  Let  be  the  parity-check  matrix  of  the  binary  (2m-i,2m-l-m) 

T  T  T 

Hamming  one-error-correcting  block  code.  Choose  matrices  , ...,P  to 

be  the  m  rows  of  the  parity-check  matrix  Il\  i.e.. 


[P1,P2,...,Pm] 


Finally,  let  P^  be  a  vector  of  2  -1  ones,  i.e.. 


P0L  =  [1,1,..., 1] 


Blahut  shows  [6,  Theorem  12.5.1]  that  the  minimum  free  distance  of  the  Wyner-Ash 
code  is  3  and,  as  a  consequence,  it  will  correct  at  least  one  error. 


Example;  For  m  =  2,  the  parity-check  matrix  of  the  Hamming  code  is 


pi  —  ^ 

H  [1  0  l1 


so  that  by  Eqs .  (53)  and  (54),  Pp1  =  [1  1  1],  P  T 
Thus  by  Eqs.  (51) 


[110],  and  P2X  -  [101] 


P(D)  =  1+D 


1+D+D 


1  +D 


and,  by  Eqs.  (34)  and  (35), 


100,  1+D+D 

010,  1+D 

001,  1  +D2 


H(D)  =  [1+D+D2,  1+D,  1+D2,  1] 


are  the  generator  and  parity-check  matrices  of  the  (4,3)  Wyner-Ash  CC, 


respectively.  Also  by  Eqs.  (37)  and  (38) 


So  that,  by  Eqs.  (39)  and  (40),  B2  =  [0  0  0  1]  and  B2  =  HT  and,  finally,  by 


Eq.  (42), 


R  =  B2B2 


1+D+D2 

000,  1+D+D2 

1+D 

000,  1+D 

o 

[0001]= 

1  +u 

000,  1+D 

_! 

0  0  0,  1 

Substituting  Eqs-  (55)  and  (56)  into  Eq.  (25)  or  directly  from  Eq-  (43) 
The  result  is 

e(D)  =  e  =  [e^,  e2,  e3>  e^] 

=  It,  (t1+z1)(l+D+D2)+(t2+z2)(l+D)+(t3+z3)(l+D2)+z4],  ( 

where 

t(D)  =  t  =  [t1,  t2,  t3l.  ( 

By  Eqs.  (41)  and  (44),  e  in  Eq.  (57)  can  also  be  expressed  as 


e 


[t,  r+s] 


( 


where  s  is  the  syndrome. 


s(D)  =  s  =  z1(l+D+D2)+z2(l+D)+z3(l+D2)+z4 


and 


r(D)  =  r  =  t.  (1+D+D2 )+t,(  1+D) +t.,(  1+D2) 


( 


y.VAV'VAV.V.’  •,'Vrvi %■  '.'v-  V*v-  ---  '  -  V-vMiJli'- ■  ''.V-.V.J:.  •  -■-* „■  r 


Define  the  truncation  of  e(D)  at  stage  or  frame  time  N  as 

N 

[e(D) ]  —  £  [e. . ,e_ , , . . . ,e  . ]D 

“  j_o  ^3  nJ 

Thus  the  Hamming  weight  of  the  sequence  of  possible  errors  in  N  frames  is 

1 1  te(D)  JN|  |  =  ||teire2j . enj]|| 

N 

=  l  ||coef[e(D)]||. 

3-°  d3 

By  Eqs.  (57)  and  (63)  for  this  particular  example  of  a  convolutional  code. 


coef  [e(D)  ]  -  [ty  ,t2j  ,t3J  ,rj+Bj  ] 
DJ 


where 


r.  =  t,  .+t,  .  ,+t,  .  „+ 

3  1,3  l,j-l  1,J -2 


t2,j+t2,j-l+ 


+t3,j-2 


Z,  .+Zi  .  i+Z,  .  .+ 

1 3  1.3-1  1,3-2 

Z2j+Z2 » j-l+ 

z~.  +Z_  .  „+ 

33  3,j-2 


If  the  values  of  at  frame  time  j  are  imagined  to  be  generated  by  a  sequential 


circuit,  then  the  pair 


where 


°j =  ^-I’V^ 


-j-1  =  ltl,j-l,t2,j-l,t3,j-l1 


mstmc&Bsm 


constitutes  the  values  of  the  internal  states  of  the  circuit  and  vector  t.  is  the 

~2 

j-th  input  to  the  circuit. 

Let  the  sequential  circuit  with  output 


uj  =  Icj*  <68> 

then  by  Eq.  (59),  the  error  trellis  of  the  code  is,  for  all  path  generated, 

Vj  =  [t^,  Sj+r(t^  ,°j)  1  •  (69) 

To  illustrate  the  above  concepts,  let  the  input  to  the  present  example  of 
the  CC  be 

x  -  [1  1  1,  0  0  0,  1  1  1,  0  0  0,  1  1  1], 

i.e.,  Xj^  =  [10  10  1]=^  =  x3.  By  the  generating  matrix  given  in  Eq.  (55), 
the  output  y  =  [y^,  ,  y y  y^]  are  obtained  as  follows: 

yi  =  y2  =  y3  =  X1  =  [I  0  1  0  l]  and 
yA  -  (1+IHD2)x1+(1+D)x2+(1+D2)x3. 

Explicitly, 

yA  =  [1010100]. 

Thus,  the  output  of  the  encoder  is 

y*=  [1  1  1  1,  0  000,  1  1  1  1,  000  0,  1  1  1  1]  (70) 
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Assume  y,  given  in  Eq.  (70)  is  transmitted  over  a  binary  symmetric  channel 
(BSC)  with  probability  of  error  somewhat  less  than  =  0.0833.  Then,  the 
received  code  sequence  is  likely 


z=  [1101,  0000,  1111,  0000,  0111) 


^■[10100],  *2-110101], 

*,-[00101],  *.-[10101], 


By  Eq.  (60),  the  syndrome  sequence  for  this  value  of  received  sequence  is 


s  =  [1010111) 


It  is  shown  in  Ref.  6,  p.  366,  that  the  present  3/4  rate  code  of  this  example 
can  correct  one  error  in  every  3  frame  times  or  code  length  of  12.  As  a  consequence, 
one  needs  only  to  correct  one  error  every  3  frames.  This  limits  the  number  of 
t  =  [t^.t^.t^l  to  4,  namely  the  values 


[000]  =  0, 


[010]  =  2, 


[1  0  0]  =  1 


[0  0  1]  =  3 


Figure  1  shows  a  constrained  regulator  trellis  with  outputs  [t,r).  In 

Fig.  1,  note  that,  because  of  the  limited  error-correction  capability  of  the 

2 

code,  the  number  of  internal  states  a  -  (Dt,  D  t)  of  the  circuit  can  be  limited 
to  7  out  of  possible  64.  Moreover,  the  number  of  state  transitors  can  be 
limited  to  those  shown  in  Fig.  1  for  the  regulator  trellis  diagram.  The  branches 
of  the  trellis  arc  labeled  with  the  value  [t,r).  For  example,  the  branch  from 
state  o  »  [0  0]  to  o  =  (3  0]  is  labeled  by  [t,r]  =  [3,1]  =  [0,0, 1,1),  which 


■  \  ■  s’V.VW’.V 


Constrained  regulator  trellis 
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means  ^  -  0,  t2  =  0,  t3  »  1,  and  r  -  1. 

To  decode  the  message  in  Eq.  (71),  by  Eq.  (68)  an  error  trellis  is  created 
by  adding  the  vector  [0,s]  to  all  labels  in  the  regulator  trellis  where,  s  is  the 
syndrome  value.  Thus,  in  Fig.  2,  the  value  of  [0,s],  where  s  is  the  syndrome 
value  in  Eq.  (72),  appear  on  all  possible  transitions  o  =  [0  0]  to  a  m  [0  0] 
on  the  top  line  of  the  error  trellis.  At  each  node,  the  cumulative  Hamming  weight 
of  the  path,  passing  through  that  node,  is  written.  The  Hamming  weight  at  each 
node,  plus  the  weight  of  a  possible  branching  from  that  to  the  next  node,  is  used 
to  eliminate  branches.  To  illustrate,  in  Fig.  2  there  are  four  branches  at 
frame  z  which  could  go  to  state  or  node  a  =  [0  0].-  The  transition  is  chosen  in 

the  branch  from  a  =  [03]  to  0  =  [00].  Since  the  node  weight  2  plus  branch 

weight  0  is  2,  the  minimum  4  possible  transitions. 

The  minimum  overall  path  weight  of  the  error  trellis  in  Fig.  2  is 

[0  0,  3  0,  0  3,  0  0,  0  0,  1  0,  0  1,  0  0,  0  0] 

2 

in  terms  of  state  values  0  =  [Dt,  D  t].  Hence,  based  on  the  criterion  of 
Eq.  (27),  the  best  estimates  of  t  is 

t  =  [3,  0,  0,  0,  1,  0,  0,  0] 

«  [0  0  1,  0  0  0,  0  0  0,  0  0  0,  1  0  0,  0  0  0]. 

If  this  vector  is  added  component-wise  to  z  in  Eq.  (71),  the  message  is 

corrected  to  yield  x  =  x,  the  original  message. 


Error  trellis  with  Input  and  state-transition  constraints 
for  one-error-correcting  Wyner-Ash  convolutional  code. 
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